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PREFACE 


The  research  reported  in  this  paper  was  conducted  at  the 
Armstrong  Laboratory,  Human  Resources  Directorate,  Aircrew 
Training  Research  Division,  at  Williams  Air  Force  Base,  Arizona, 
under  Work  Unit  1123-05-01,  Xn-House  Research  and  Development 
Support. 

The  purpose  of  this  research  was  to  develop  a  general  model 
that  would  allow  for  the  benefit-cost  evaluation  of  multiship 
training  simulation  systems.  The  model  developed  is  a  decision¬ 
making  tool  for  Air  Force  managers  to  compare  between  and  among 
different  simulation  systems  intended  to  supplement  and  enhance 
aircrew  training. 

The  model  developed  was  implemented  through  a  series  of 
LOTUS  1-2-3  spreadsheets  to  facilitate  analysis  and  "what-if" 
comparisons.  The  spreadsheets'  design  and  use  are  described  in 
this  paper  and  illustrated  in  the  appendixes. 


DTIC  QUALITY 


nraPBCTEuS 


Aooesslon  For 

NTIS  GRA&I 

DTIC  TA3 

□ 

Unanro'ir.ceA 

□ 

Juil  if  L:. ration _ 

By— 

Distribution./ 


Availability  Codas 
jAvail  and/or 
Special 


Dlat 


BENEFIT-COST  MODEL  FOR  THE  EVALUATION  OF 
SIMULATOR-BASED  MULTI SHIP  TRAINING  ALTERNATIVES 


INTRODUCTION 

The  purpose  of  this  project  is  to  develop  a  method  of  applying  the 
technique  of  benefit-cost  analysis  to  the  evaluation  of  simulation  systems 
which  are  intended  to  provide  training  to  pilots  in  the  United  States  Air 
Force  (USAF).  While  benefit-cost  analysis  is  a  widely  documented  and  well 
understood  technique,  the  mechanisms  for  establishing  and  measuring  benefits 
are  not  universally  defined  and  must  be  developed  for  each  specific 
application.  The  evaluation  of  using  simulation  as  a  training  technique  is 
one  such  application  area. 

Simulation  as  a  means  of  helping  to  train  pilots  to  fly  war  planes  has 
been  used  since  World  War  II  (or  before)  and  is  widely  used.  However,  many  of 
the  simulation  systems  that  have  been  widely  adopted  provide  a  relatively 
narrow  training  spectrum  such  as  emergency  procedures  or  instrument  training. 
Nonflying,  computer-based  simulation  systems  capable  of  assisting  in  much 
wider  spectra  of  pilot  needs  exist  but  are  generally  confined  to  single 
systems  being  studied  in  research  and  development  environments. 

With  the  rapid  technological  improvements  made  in  microcomputers  and 
vision  systems,  it  is  possible  to  construct  relatively  inexpensive,  high 
performance  simulation  systems  that  could  be  used  to  meet  many  of  the  training 
enhancement  needs  of  the  Air  Force.  The  difficulty  would  be  to  select  the 
system,  or  systems,  which  would  provide  the  greatest  training  benefit  at  a 
cost  within  budgetary  limitations.  Providing  a  benefit  model  that  would  be 
applicable  to  any  simulation  system,  either  currently  available  or  proposed, 
would  help  to  alleviate  this  difficulty.  The  focus  of  this  evaluation  would 
be  on  an  Air  Force-wide  implementation  of  simulation  systems  rather  than  the 
design  or  use  of  any  single  system. 

In  addition,  most  simulation  systems  are  not  constructed  to  enhance 
multiperson  (or  multiship)  interaction  in  the  simulated  environment.  Since 
the  USAF  norm  is  that  war  planes  fly  and  fight  in  pairs,  or  in  multiples  of 
pairs,  it  would  be  useful  to  have  simulation  systems  that  emphasized  this 
important  characteristic.  Developing  a  benefits  model  which  provides  the 
basis  for  economically  evaluating  and  comparing  such  systems  would  help  assure 
that  useful  as  well  as  economic  systems  would  be  implemented. 

This  report  attempts  to  help  meet  the  above  needs  by  presenting  a 
benefit-cost  measurement  model  that  can  be  applied  to  any  simulation  system  or 
environment  proposed  for  multiship  training  simulation.  It  accomplishes  this 
by  first  creating  a  set  of  possible  simulation  alternatives  that  could  provide 
simulation-based  multiship  training.  It  then  presents  attributes  of 
simulation  environments  which  form  the  basis  for  evaluating  the  benefits  of 
the  simulation  alternatives.  These  attributes  are  combined  with  evaluation 
elements  to  form  a  benefits  model  which  can  yield  the  estimated  dollar  values 
that  are  used  in  establishing  benefit-cost  ratios.  The  cost  model  used  is 
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based  on  existing  accounting  models,  Air  Force  regulations,  and  cost  estimates 
drawn  from  literature  and  expert  opinion.  The  overall  benefit-cost  model  is 
applied  to  the  alternatives  to  illustrate  its  usability. 

Benefit-Cost  Analysis 

There  is  a  general  consensus  in  the  economic  literature  that  a 
benefit-cost  analysis  is  appropriate  for  any  government  program  that  involves 
an  impact  on  a  segment  of  the  population  [Maciariello,  1975;  Pearce,  1983; 
Steiner,  1980].  Enhancing  the  training  of  pilots  for  the  USAF  meets  this 
criterion.  Therefore,  alternative  methods  of  providing  such  training  should 
be  amenable  to  this  analysis. 

There  is  also  a  general  agreement  (Maciariello,  1975;  Pearce,  1983; 
Oxenfeldt,  1979]  that  a  benefit-cost  analysis  includes: 

1.  A  specification  of  the  goal(s)  or  objective(s)  which  the 
programs  are  intended  to  achieve. 

2.  An  enumeration  and  definition  of  the  alternatives  which  are 
proposed  as  mechanisms  for  reaching  these  goal(s). 

3.  A  definition  of  the  means  of  evaluating  the  benefits  derivable 
from  each  alternative.  This  includes  the  definition  of  the  means  of 
converting  benefits  into  quantitative  (dollar  measurable)  terms. 

A.  A  definition  of  the  means  of  evaluating  the  costs  required  to 
implement  each  alternative. 

5.  A  completed  analysis  showing  the  computed  incremental 
benefit/cost  (B/C)  ratios  for  all  alternatives  being  evaluated.  Alternatively, 
incremental  net  benefits  may  be  used  as  a  basis  for  evaluating  alternatives.) 

The  specific  goal  for  the  alternatives  to  be  evaluated  in  this  review  is 
"to  enhance  the  training  of  combat  pilots  through  the  use  of  multiship 
simulation  systems."  Therefore,  the  benefit-cost  analysis  should  provide  a 
means  of  comparing  any  alternative  which  has  the  capability  of  achieving  this 
goal.  A  representative  set  of  alternatives  which  meet  the  goal  and  the 
criteria  by  which  they  were  generated  will  be  presented  in  the  next  section. 

However,  the  development  of  the  means  of  evaluating  the  benefits  of 
these  alternatives  is  regarded  as  the  most  important  aspect  of  this  review. 
There  are  no  agreed-on  methods  for  constructing  metrics  for  evaluating 
benefits  [Maciariello,  1975;  Smith,  1986;  McDonald  et  al.,  1989]  but  it  is 
understood  that  whatever  method  is  developed,  it  must  yield  a  quantitative 
output  in  monetary  terms.  An  important  element  to  note  here  is  that  the 
method  used  to  measure  the  benefit  does  not  necessarily  imply  any  replacement 
of  existing  capability.  That  is,  measuring  the  benefit  of  an  added  capability 
in  terms  appropriate  to  an  existing  capability  does  not  mean  that  the  existing 
capability  can  be  replaced  by  the  addition.  In  the  appropriate  language,  this 
is  referred  to  as  maintaining  a  "static  framework  of  analysis"  [Maciariello, 
1975,  p.  4]. 
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Organizational  Alternatives 


The  alternatives  generated  for  this  project  are  based  on  criteria 
concerning  multiship  simulation  developed  through  an  extensive  literature 
search  [Amdor  et  al.,  1988;  Institute  for  Simulation  &  Training,  1990; 

McDonald  et  al.,  1989;  Lethert,  1985;  Graham  et  al.,  1981]  and  discussions 
with  experts  in  the  field  of  simulation  training  [Houck,  et  al.,  1990;  Genet, 
1988;  Bell,  et  al.,  1990].  It  was  felt  that  two  sets  of  criteria  were 
appropriate.  One  set  to  describe  the  conditions  which  a  simulation  system 
must  meet  to  satisfy  the  goal  specified  for  the  benefit-cost  analysis,  and  a 
second  set  to  describe  the  conditions  of  the  "simulation  environment" 
experienced  by  the  pilot  engaged  in  the  multiship  simulation  experience. 

The  first  set  of  criteria  defines  the  conditions  to  be  met  for  systems 
to  be  considered  organizational  alternatives  which  would  satisfy  the  needs  of, 
at  least,  a  definable,  operational  segment  of  the  Air  Force.  These  criteria 
are  shown  in  Table  1. 


Table  1.  Criteria  for  Organizational  Alternatives 


1.  Each  alternative  must  be  constructed  in  such  a  manner  that 
it  is  mutually  exclusive  which  respect  to  each  other 
alternative  [Pearce,  1983]. 

2.  Each  alternative  must  be  capable  of  providing  multi¬ 
ship  training/practice/maintenance  of  skills  to  all 
pilots  within  a  definable  segment  of  the  Air  Force. 

3.  Each  alternative  may  include  one,  or  more,  simulation 
environments  which  may  not  be  exclusive  between 
alternatives. 

4.  The  alternatives  will  be  established  with  respect  to  a 
specific  aircraft  type  and  configuration. 

5.  The  alternatives  are  intended  to  serve  operational 
units  (wings  or  squadrons),  not  units  devoted  primarily 
to  training  new  or  cross-training  pilots. 


The  simulation  environments  are  defined  to  be  the  man-machine  interfaces 
which  will  be  experienced  by  the  pilots  who  are  to  receive  the  training  via 
simulation.  Table  2  shows  the  basic  set  of  criteria  for  a  simulation 
environment  which  will  provide  multiship  training. 
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Table  2.  Criteria  for  Nultiship  Simulation  Environments 


1.  The  simulation  environment  must  accommodate  at  least 
two  pilots  (lead  and  vingman)  simultaneously  [Bell,  et 
al.,  1990;  McDonald  et  al.,  1989 J . 

2.  Each  pilot  must  be  able  to  "see”  his  lead/vingman  in 
the  appropriate  positions  at  all  times  (if  this  is 
possible  in  the  actual  aircraft).  This  refers  to 
visual  as  well  as  other  means  of  locating  the 
supporting  aircraft. 

3.  The  physical  environment  (cockpit)  of  each  pilot 
should  be  correct  in  terms  of  the  aircraft  being 
simulated  [Olsen,  1982]. 

4.  Communication  linkages  must  be  provided  which  reflect 
current  practice,  including  the  capability  of  ground 
control  interaction. 

5.  The  simulation  environment  must  be  kept  physically 
updated  to  reflect  the  aircraft  the  pilot  is  actually 
flying. 


ORGANIZATIONAL  ALTERNATIVES  -  EXAMPLE  APPLICATION 
Conditions  To  Be  Met  bv  Alternatives 

Based  on  the  criteria  for  organizational  alternatives  and  the  expertise 
and  development  efforts  in  simulation  training  being  accomplished  at  the 
Armstrong  Laboratory  Human  Resources  Directorate,  Aircrew  Training  Research 
Division,  at  Williams  Air  Force  Base,  Arizona,  the  following  conditions  were 
established  to  assist  in  configuring  these  organizational  alternatives.  These 
conditions  are  intended  to  make  the  alternatives  as  realistic  as  possible  for 
a  peacetime  Air  Force.  The  conditions  are  also  established  to  narrow  and 
focus  the  number  of  different  choices  that  would  otherwise  have  to  be 
evaluated  in  shaping  the  alternatives. 

1.  The  emphasis  is  on  F-15s,  exclusive  of  F-15Es.  The  F-15  is  an 
air  superiority  jet  fighter  which  was  originally  configured  for  air-to-air 
combat.  The  F-15E  is  a  newer  configuration  with  added  air-to-ground 
capability  currently  being  brought  into  use  in  the  Air  Force  [Department  of 
the  Air  Force,  1988b;  1989].  Focusing  on  the  F-15  (C  and  D  configuration) 
reduces  the  number  of  operational  squadrons  to  be  served  by  the  organizational 
alternatives  and  the  number  of  training  purposes  which  must  be  served. 

2.  There  are  approximately  18  squadrons  (6  wings)  of  F-15s  to  be 
served  by  the  organizational  alternatives  to  be  evaluated.  Assuming  there  are 
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approximately  450  F-15s  in  active  operational  service  and  that  the  pilot  force 
ratio  is  1.25  per  aircraft  and  that  there  are  approximately  22  to  26  aircraft 
per  squadron,  there  vould  be  approximately  32  pilots  per  squadron  (plus  flying 
rated  officers  not  counted  in  the  pilot  force  ratio).  This  yields  an  estimate 
of  approximately  600  to  650  pilots  to  be  served  by  the  simulation  alternative 
[Department  of  the  Air  Force,  1982;  International  Institute  for  Strategic 
Studies,  1989;  AIR  FORCE  Magazine,  1990]. 

3.  There  are  approximately  50  working/ flying  hours  in  the  current 
work  week  for  pilots.  Of  these,  no  more  than  5  to  6  hours  vould  be  available 
for  additional  simulation  training  (including  briefing,  simulation  runs,  and 
debriefing) . 


4.  All  simulation  training/practice  vould  be  performed  between 
0700  and  1900  during  the  normal  work  week.  Allowing  for  a  1/2  hour  briefing 
before  the  simulation  run  and  a  1  hour  debriefing,  the  simulator  could  be  run 
between  0730  and  1800.  This  allows  for  approximately  10.5  hours  of  simulation 
sorties  per  cockpit  per  day  per  simulation  environment. 

5.  If  there  are  an  average  of  35  pilots  per  squadron  and  each 
pilot  receives  2  simulation  sorties  per  veek,  each  simulation  organizational 
alternative  should  allow  for  70  simulation  sorties  per  veek  per  squadron. 

6.  All  sorties  and  simulation  runs  are  performed  by,  at  least,  2 
plane  (pilot)  elements. 

7.  Each  organizational  alternative  should  provide  for  the  use  of 
ground  control  and  2  (or  more)  opponent  aircraft  (human  or  computer  control). 

8.  All  components  used  in  the  alternatives  must  be  currently 
commercially  available  or  be  developed  to  the  extent  that  commercial 
specifications  can  be  stated. 

9.  Each  organizational  alternative  should  include  the  capacity  to 
build  and  disseminate  simulation  databases  to  locations  of  use. 

Alternative  Components 

Using  the  general  criteria  for  organizational  alternatives  and  the 
conditions  established  for  these  alternatives,  the  following  components  were 
selected  to  form  an  example  set  of  organizational  alternatives: 

1.  Combat  Engagement  Trainer  (CET).  Includes  a  cockpit  which 
correctly  emulates  an  F-15  and  its  information  displays,  all  necessary 
computer  cables,  blackout  canopy,  etc.  (does  not  include  the  computers 
necessary  to  operate  the  CET). 

2.  Display  for  Advanced  Research  and  Technology  (DART)  Dome. 
Includes  a  cockpit  which  correctly  emulates  an  F-15  and  its  information 
displays,  a  dome  composed  of  hexagonal  projection  panels  for  computer¬ 
generated  displays,  all  necessary  computer  cables,  all  necessary 
projection  equipment,  etc.  (does  not  include  the  computers). 
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3.  Visual  Display  Helmet  with  Head  Tracking  Equipment.  Includes 
all  necessary  computer  cables,  etc.  (does  not  include  the  computers). 

4.  Fiber  Optic  Helmet-Mounted  Display  (FOHMD)  with  Head  Tracking 
Equipment.  Includes  all  necessary  computer  cables,  etc.  (does  not  include  the 
computers) . 


5.  Control/Communication/Linkage  Computer 

a.  Level  I  -  Links  two  CETs  to  fly  as  an  element  (could  be 
used  for  1  v  1  practice).  Used  to  receive  the  download  of  a  display  data 
base.  Allows  for  computer-generated  opponents. 

b.  Level  II  -  Possesses  all  characteristics  of  Level  I.  Can 
handle  input/output  functions  for  up  to  4  v  4  engagements. 

6.  Host  Computer.  Linked  to  simulation  environment  for  display 
and  interaction. 


a.  Host  I  -  Linked  to  CET  in  Level  I  configuration. 

b.  Host  II  -  Linked  to  CET  in  all  other  configurations 
(capacity  is  adequate  for  4  v  4  engagements). 

c.  Host  III  -  Linked  to  DART  dome  and  visual  display  helmet. 

d.  Host  IV  -  Linked  to  DART  dome  and  visual  display  helmet. 

7.  Image  Generated  (IG)  Computer.  Computer  necessary  for 
generating  appropriate  images  for  the  DART  dome. 

a.  IG  I  -  Linked  to  DART  with  visual  display  helmet. 

b.  IG  II  -  Linked  to  DART  with  FOHMD. 

8.  Ground  Control  Intercept  (GCI)  Computer.  Computer  which 
allows  the  simulation  center  manager  (or  other  person)  to  act  as  a  ground 
control  officer. 


9.  Briefing/Debriefing  Computer  and  Displays.  Basically,  a  small 
computer  for  the  named  purpose  and/or  pilot  reviews  of  archived  simulation 
flights. 

Specification  of  Alternatives 

Based  on  the  criteria  and  conditions  for  organizational  alternatives, 
the  following  four  alternatives  were  established.  These  alternatives  form  a 
representative  set  rather  than  an  exhaustive  set  of  ways  multiship  simulation 
training  could  be  provided  to  operational  pilots.  Block  diagrams  representing 
these  alternatives  may  be  seen  in  Appendix  A. 
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Alternative  I.  Pair  of  CETs  with  visual  display  helmets  in  each 
squadron,  no  cross-linking  between  squadrons.  Direct  (download)  link 
with  Data  Base  Development  Center.  Ground  control  provided  by  simulation 
personnel  (permits  element  simulation  with  computer  opponent). 

Alternative  II.  Pair  of  CETs  with  visual  display  helmets  in  each 
squadron,  full  cross-linking  among  squadrons  within  the  wing,  no  other 
cross-linking  possible.  Direct  (download)  link  with  Data  Base  Development 
Center.  Ground  control  provided  by  simulation  personnel  (permits  up  to  4  v  2 
simulation  with  human  opponent). 

Alternative  III.  Pair  of  CETs  with  visual  display  helmets  in  each 
squadron  and  a  pair  of  DART  domes  with  visual  display  helmets  at  a  wing 
location,  full  cross-linking  among  all  elements  within  the  wing,  no  other 
cross-linking  possible.  Direct  (download)  link  with  Data  Base  Development 
Center.  Ground  control  provided  by  simulation  personnel  (permits  up  to  4  v  2 
simulation  with  human  opponents). 

Alternative  IV.  Pair  of  CETs  with  visual  display  helmets  in  each 
squadron  and  four  regional  centers,  each  center  with  four  DART  domes  with 
FOHMD  (pilots  would  cycle  through  regional  centers),  full  cross-linking  among 
any  set  of  four  squadrons  (for  each  regional  center).  Direct  (download)  link 
with  Data  Base  Development  Center  (permits  up  to  4  v  4  simulation  with 
human  opponents). 


BENEFITS  MODEL  -  GENERAL  DEVELOPMENT 

Th~  development  of  the  general  method  for  benefits  measurement  is  based 
on  the  desire  to  create  a  general  model  that  (a)  would  be  able  to  evaluate  any 
proposed  alternative  for  multiship  simulation  training,  (b)  would  be 
acceptable  and  usable  by  both  those  who  develop  such  simulation  systems  as 
well  as  those  trained;  (c)  would  be  easily  understood  and  manipulated  for 
evaluation  and  sensitivity  analysis,  (d)  would  maintain  internal  consistency 
so  that  a  set  of  different  organizational  alternatives  could  be  usefully 
compared,  and  (e)  could  yield  dollar  figures  for  internal  comparison  without 
the  demand  that  these  same  "dollars"  could  ever  be  found  in  a  balance  sheet. 

To  these  ends,  the  following  conditions  were  imposed: 

1.  The  well-documented  concept  of  transfer  effectiveness  ratios 
(Orlansky  &  Chatelier,  1983;  Orlansky  &  String,  1982)  would  not  be  used. 
Transfer  effectiveness  ratios  specifically  assume  that  simulation  would  be 
used  instead  of  the  aircraft.  It  is  the  explicit  assumption  of  this  research 
that  no  replacement  of  aircraft  flying  hours  would  take  place.  All  benefits 
accruing  due  to  the  use  of  simulation  would  be  derived  as  additions  to  the 
training/preparedness  of  the  pilots. 

2.  As  much  comparison  to  the  way  the  actual  aircraft  is  used  for 
operational  training  was  sought. 

3.  The  concept  of  "shadow  prices"  was  implicitly  used.  The 
"shadow  price"  could  be  the  marginal  cost  of  actually  using  the  aircraft  if 
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compared  to  training  currently  taking  place  but  could  be  adjusted  (upward  or 
dovnvard)  to  account  for  the  costs  of  training  for  activities  proscribed  for 
the  aircraft  in  a  peacetime  environment  (e.g.,  electronic  warfare  counter¬ 
measures,  air-to-air  missile  use). 

4.  The  assumption  is  that,  with  rapid  changes  in  technology  and 
weaponry,  no  pilot  is  ever  fully  trained  in  all  aspects  of  multiship  combat. 
Therefore,  the  learning  curve  for  each  pilot  is  in  its  linear  portion  prior  to 
becoming  asymptotic. 

Performance  Areas 

For  purposes  of  this  project,  a  performance  area  is  defined  as  an 
operational  activity  for  which  a  sortie  would  be  scheduled  so  that  a  pilot 
could  acquire,  improve,  or  maintain  the  skills  necessary  to  carry  out  that 
specific  activity.  It  is  assumed  that  the  performance  area  is  sufficiently 
"large"  in  numbers  of  behavioral  skills  that  a  sortie  would  be  practicable  for 
each  specific  performance  area.  It  is  recognized  that,  in  reality,  many 
sorties  are  used  to  practice  more  than  one  performance  area,  but  for  purposes 
of  comparison  only,  "pure"  sorties  (exactly  one  performance  area)  are  being 
considered. 

The  Performance  Areas  are  identified  as  PA(i),  where  i  refers  to  a  spe¬ 
cific  performance  area  and  m  is  the  maximum  number  of  performance  areas  to  be 
investigated  for  the  set  of  organizational  alternatives  (i  =*  1,  .  .  .  . ,  m). 

Simulation  Environment 

Simulation  environment  is  the  environment  (inside  the  simulator)  of  the 
pilot  who  is  practicing  the  Performance  Area.  Each  simulation  environment 
would  not,  necessarily,  be  unique  to  a  specific  organizational  alternative. 

The  evaluation  of  an  alternative  will  combine  the  appropriate  simulation 
environments.  The  SIMulation  environment  is  identified  as  SIM(j);  where  j 
refers  to  the  specific  simulation  environment  and  n  is  the  total  number  of 
environments  for  the  set  of  organizational  alternatives  (j  -  1,  .  .  .  . ,  n). 

Degree  <ff  RnlfiHnn 

Emulation  is  a  term  being  used  to  represent  the  degree  to  which  a 
specific  simulation  environment  represents  the  actual  environment  experienced 
in  the  aircraft  for  the  specific  performance  area.  This  term  can  only  be 
numerically  defined  by  a  pilot  experienced  in  the  aircraft  in  question  and 
experienced  in  the  specific  simulation  environment.  It  is  a  subjective 
measure  that  includes  all  aspects  of  flying.  The  value  of  the  emulation  would 
be  measured  by  expert  opinion,  properly  controlled,  and  would  range  from  a 
value  of  0.00  for  a  totally  useless  simulation  environment  to  1.00  for  a 
simulation  environment  that  perfectly  matched  the  aircraft.  (Strictly 
speaking,  this  scale  should  allow  for  negative  values  for  a  simulation  which 
negatively  influences  training/learning.) 
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The  Emulation  capability  of  the  SIMulation  environment  is  identified  as 
ESIH(i,j). 

The  relationship  among  PA(i),  SIM(j)  and  ESIM(i,j)  may  be  shown 
graphically: 


Simulation  Environments 
1  2  .  ...  j  ....  m 

1 

Performance  Areas  i  ESIM(i,j) 

n 


Aircraft  Training/Practice  Sortie.  A  sortie  where  one,  and  only  one, 
performance  area  is  practiced.  The  aircraft  is  flown  and  "reset"  as  many 
times  as  possible  in  the  sortie  to  repeat  the  same  activity. 

1.  Aircraft  Sortie  Duration:  The  average  time  for  such  a  sortie  for 
each  performance  area. 

The  Aircraft  sortie  Time  is  identified  as  AT(i). 

2.  Performance  Area  Iterations:  The  number  of  times  the  specific 
performance  could  be  practiced  per  sortie. 

The  Aircraft  Repetitions  are  identified  as  AR(i). 

Simulation  Training/Practice  Sortie.  A  simulation  run  devoted  to  the  practice 
of  one  specific  performance  area. 

1.  Simulation  Sortie  Duration:  The  average  time  for  such  a  sortie  for 
each  performance  area.  This  time  period  is  intended  to  be  held  equal  to  the 
corresponding  aircraft  sortie  duration  to  facilitate  later  computations. 

The  Simulation  sortie  Times  are  identified  as  ST(i). 

2.  Simulation  Performance  Area  Iterations:  The  number  of  times  the 
specific  performance  could  be  practiced  per  simulation  sortie. 

The  Simulation  Repetitions  are  identified  as  SR(i). 

Degree  of  Simulation  Compression.  Ratio  of  the  number  of  times  a  given 
Performance  Area  can  be  practiced  in  a  simulator  versus  an  aircraft.  This 
provides  a  measure  of  the  increased  (normally)  training/practice  capacity  of 
the  simulation  environment. 

The  Degree  of  Simulation  Compression  is  identified  as  DSC(i,j)  and 
is  computed  by  SR(i, j )/AR(i) . 
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Simulation  Benefit  Factor.  Simulation  Benefit  Factor  is  a  correction  factor 
computed  from  the  simulation  compression  factor  and  the  degree  of  emulation. 
This  factor  is  used  directly  in  computing  the  overall  benefits  imputed  to  each 
organizational  alternative. 

The  Simulation  BENefit  factor  is  identified  as  SBEN(i,j)  and  is 
computed  by  ESIM(i,j)*DSC(i,j). 

Directly  Measured  Benefit  Elements.  These  factors  are  based  on  the  shadov 
costs  for  the  use  of  aircraft  and  weaponry  approximated  by  the  marginal  costs 
of  the  equipment.  These  factors  are  intended  to  directly  reflect  the 
training/practice  benefit  accruing  due  to  the  use  of  simulation. 

1.  Marginal  (incremental)  Aircraft  Cost.  Cost  of  flying  the  aircraft 
on  a  per  sortie  basis  (or  per  hour),  corrected  for  Performance  Area  if 
appropriate. 

The  Marginal  Aircraft  Cost  is  identified  as  MAC$(i). 

2.  Veaponry  Cost.  Cost  of  using  ammunition,  weaponry  or  other 
consumables  expended  per  aircraft  sortie  for  each  Performance  Area.  This  cost 
would  include  a  factor  for  all  damage  (peacetime)  due  to  the  use  of  the 
weaponry. 


The  VEAPonry  cost  is  identified  as  VEAP(i). 

Indirectly  Measured  Benefit  Elements.  These  factors  are  based  on  potential 
losses  of  pilots  and  aircraft  used  in  flying  sorties.  They  are  indirect  in 
the  sense  that  they  are  based  on  sortie  time  rather  than  a  measure  of  training 
benefit.  They  are  a  measure  of  risk  rather  than  training. 

1.  Aircraft  Loss  Cost.  Cost  of  loss  of  the  aircraft  as  a  function  of 
its  use  in  flying  sorties  of  the  specific  Performance  Area.  This  is  a 
probability-based  measure  computed  by  (Cost  of  an  aircraf t)*(Probability  of 
loss  per  sortie). 

The  AIRcraft  loss  Cost  is  identified  as  AIRC$(i). 

2.  Pilot  Death  Cost.  Cost  of  losing  a  pilot  due  to  a  training  accident 
as  a  function  of  his  exposure  to  risk  in  specific  Performance  Areas.  This  is 
a  probability-based  measure  computed  by  (cost  of  the  pilot)*(Probability  of 
loss  per  sortie). 

The  PILot  death  Cost  is  identified  as  PILC$(i). 

Number  of  Simulation  Sorties.  The  total  number  of  simulation  sorties  that  can 
be  performed  in  a  specified  simulation  environment  for  each  Performance  Area 
for  each  organizational  alternative  in  a  year.  This  number  is  the  basis  for 
the  computation  of  the  total  estimated  benefits  accruing. 

The  NUMber  of  sorties  is  identified  as  NUM(i,j). 


10 


Tot:  Benefits  Model.  The  total  estimated  benefits  for  each  organizational 
alt*.  .ative  per  year  is  computed  by  the  folloving  equation: 

Benefits  -  EE  (NUM(if j)*SBEN(i,j)*MAC(i)} 
i  j 

+  EE  {NUM(i, j)*SBEN(i, j)*VEAP$(i)} 
i  i 

+  EE  {NUM(i,j)*(AIRC$(i)  +  PILC$(i))} 
i  j 

These  values,  for  each  alternative  in  a  set  of  alternatives,  are  the  benefits 
values  for  the  final  benefit  cost  evaluation.  The  total  benefits  model 
including  all  subordinate  tables  and  values  has  been  implemented  in  the  form 
of  a  LOTUS  1-2-3  spreadsheet  which  allows  for  relatively  easy  arithmetic 
manipulation  and  sensitivity  analysis. 

BENEFITS  MODEL  -  EXAMPLE  APPLICATION 

The  intent  of  this  application  is  to  demonstrate  the  utilization  of  the 
benefits  model  to  as  realistic  a  situation  as  possible.  In  order  to  allow  for 
this,  an  "unrealistic"  use  of  simulation  is  specified  to  directly  duplicate 
the  training/ practice  of  combat  pilots  as  it  is  currently  being  performed  in 
operational  squadrons.  To  this  end,  intensive  interviews  with  pilots,  and 
review  of  Air  Force  and  other  government  documents  are  used  to  make  estimates 
of  the  various  components  of  the  benefits  computation. 

It  is  suggested  that,  based  on  the  assumptions  previously  stated,  the 
more  practical,  "real"  use  of  simulation  is  to  train  in  performance  areas 
which  are  proscribed  in  peacetime.  However,  to  model  benefits  in  this 
situation  would  make  examination  and  validation  of  results  far  more  difficult. 

Performance  Areas.  The  performance  areas  selected  for  the  model  are  drawn 
from  Air  Force  Manual  (AFM)  51-50  used  for  specifying  squadron  operations  (AFM 
51-50,  1989].  These  areas,  "tasks"  in  the  manual,  are  the  actual  operational 
purposes  of  sorties  scheduled.  As  such,  they  are  well  understood  by  pilots 
and  allow  for  direct  comparison  to  uses  specified  for  simulation  environments. 

These  are  the  same  as  "tasks"  identified  in  Table  Al-2,  Standard  Sortie 
Planning  Factors,  of  AFM  51-50.  A  total  of  20  such  planning  "tasks"  are  shown 
in  this  table  but  only  the  last  seven  are  appropriate  for  F-15  air-to-air  com¬ 
parison.  These  are  numbered  in  the  order  shown  in  the  Table  and  listed  below. 

Performance  Areas  used  for  this  example: 


Air  Superiority 

Air  Defense 

14. 

Intercepts  (Day /Night) 

18. 

Intercepts  (Day/Night) 

15. 

ACBT 

19. 

ACBT 

16. 

DART 

20. 

DART 

17. 

CFT 
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Simulation  Environmgnl.  The  simulation  environments  are  defined  by  the 
Organizational  Alternatives  previously  presented  and  shovn  belov. 

Simulation  Environments  used  for  this  example: 

1.  CET  cockpit  -  visual  display  helmet ,  linked  to  one  other  simulated 
environment*  opponents  computer  generated. 

2.  CET  cockpit  -  visual  display  helmet,  may  be  linked  to  more  than  one 
other  simulated  environment,  opponents  may  be  human  piloted. 

3.  DART  dome  cockpit  -  visual  display  helmet,  may  be  linked  to  more 
than  one  other  simulated  environment,  opponents  may  be  human  piloted. 

4.  DART  dome  cockpit  -  FOHMD  helmet,  may  be  linked  to  more  than  one 
other  simulated  environment,  opponents  may  be  human  piloted. 

Degree  of  Emulation.  Values  for  the  ESIM(i,j)  factors  were  derived  from  a 
series  of  intensive  interviews  vith  fighter  pilots  (an  average  of  over  18 
years  experience)  who  vere  also  experienced  vith  the  use  of  simulation.  None 
of  these  pilots  vere  willing  or  able  to  provide  more  than  very  approximate 
values  for  the  factors  nor  vere  they  able  to  distinguish  among  the  performance 
areas  as  to  differential  effects.  Due  to  the  degree  of  approximation,  the 
lowest  estimated  values  vere  used. 


Table  3.  Matrix  of  Values  for  Emulation  Measures 


ESIM(i,j) 


Performance  Simulation  Environments  (j) 


areas 

CET 

CET 

Domes 

Regional 

Centers 

(i) 

Not  Linked 

Interlinked 

CET  in  squad 

CET  in  squad 

1 

2 

3 

4 

14 

0.0150 

0.0300 

0.0700 

0.1000 

15 

0.0150 

0.0300 

0.0700 

0.1000 

16 

0.0150 

0.0300 

0.0700 

0.1000 

17 

0.0150 

0.0300 

0.0700 

0.1000 

18 

0.0150 

0.0300 

0.0700 

0.1000 

19 

0.0150 

0.0300 

0.0700 

0.1000 

20 

0.0150 

0.0300 

0.0700 

0.1000 
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Aircraft  Training/Practice  Sortie.  The  same  series  of  interviews  with 
experienced  pilots  yielded  average  figures  for  sortie  duration  and  number  of 
repetitions  for  the  performance  areas.  The  values  for  repetitions  were  the 
maximum  values  of  the  estimates. 

Table  4.  Aircraft  Sortie  Values 


Aircraft 
Sortie  Time 
AT(i) 

1.40 

1.30 

1.30 

1.30 

1.40 

1.30 

1.30 


Aircraft 

Repetitions 

AR(i) 

6 

3 

3 

3 

6 

3 

_ 2 _ 


Simulation  Training/Practice  Sortie.  The  pilot  interviews  were  used  to 
establish  time  estimates  for  the  time  to  repeat  one  iteration  for  each 
performance  area.  This  time  was  doubled  (to  allow  for  resetting  the 
simulation  environment)  and  used  to  establish  the  number  of  repetitions  within 
each  simulation  environment.  ST(i)  is  held  equal  to  AT(i). 


Table  5.  Simulation  Repetitions 


SR(i,J) 


1 

2 

3 

4 

10 

10 

10 

10 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

10 

10 

10 

10 

8 

8 

8 

8 

8 

8 

8 

8 

Simulation  Benefit  Factor.  The  table  of  simulation  benefit  factors  was 
computed  using  the  above  data.  Note  that  this  table  includes  in  the 
computation  the  values  for  the  degree  of  simulation  compression. 

Table  6.  Simulation  Benefit  Factors 


SBENUi.i)  =  ESIMf  i .  i  )*(  SR(  i ,  i  )/AR(  i ) ) 


1 

2 

3 

4 

0.0250 

0.0500 

0.1167 

0.1667 

0.0400 

0.0800 

0.1867 

0.2667 

0.0400 

0.0800 

0.1867 

0.2667 

0.0400 

0.0800 

0.1867 

0.2667 

0.0250 

0.0500 

0.1167 

0.1667 

0.0400 

0.0800 

0.1867 

0.2667 

0.0400 

0.0800 

0.1867 

0.2667 
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Benefit  Elements.  The  values  for  the  benefit  elements  were  derived  from  the 
1988  and  1989  Air  Force  budgets  (Department  of  the  Air  Force,  1987;  1988a; 
1988b)  plus  other  documents  which  delineated  estimates  for  the  value  of  a 
pilot's  life  (U.S.  General  Accounting  Office,  1987),  costs  of  operating  an 
F-15  (Institute  for  Simulation  &  Training,  1990),  and  costs  of  various  weapons 
(Department  of  Defense,  1990).  The  very  arbitrary  estimate  was  made  that,  in 
the  two-year  period  (1988  and  1989),  two  aircraft  had  been  totally  lost  and 
four  pilots  killed.  These  estimates  were  combined  with  total  hours  flown  in 
those  two  years  to  estimate  the  loss  cost  values.  All  cost  figures  were 
corrected  using  Consumer  Price  Index  (CPI)  correction  values  (Directorate  of 
Engineering  and  Services,  1988,  p.  6)  to  appropriate  1990  values. 

Table  7.  Benefit  Conversion  Factors 


Aircraft 

use 

MAC$(i) 

Veapons 

use 

VEAP$(i) 

Loss  of 

aircraft 

AIRC$(i) 

Loss  of 

pilot 

PILC$(i) 

$6,300.00 

$2,000.00 

$266.00 

$116.76 

$5,850.00 

$2,000.00 

$247.00 

$108.42 

$5,850.00 

$2,000.00 

$247.00 

$108.42 

$5,850.00 

$2,000.00 

$247.00 

$108.42 

$6,300.00 

$2,000.00 

$266.00 

$116.76 

$5,850.00 

$2,000.00 

$247.00 

$108.42 

$5,850.00 

$2,000.00 

$247.00 

$108.42 

Number  of  Simulation  Sorties.  The  number  of  simulation  sorties  available  for 
each  simulation  environment  for  all  F-15  squadrons  and  pilots  was  calculated 
based  on  the  following  assumptions  about  operating  hours  and  procedures. 

1.  All  squadron  and  wing  simulation  centers  would  operate  12  hours  per 
day  for  a  5-day  week,  50  weeks  per  year. 

2.  The  regional  simulation  centers  would  operate  8  hours  per  day  for  a 
5-day  week,  50  weeks  per  year. 

3.  Pilots  would  always  be  available  to  take  part  in  the  simulation 
sorties  (There  are  more  pilots  than  aircraft  in  all  squadrons.). 

4.  A  20%  reduction  in  maximum  number  of  sorties  was  used  to  account  for 
scheduling  errors,  illness,  equipment  malfunction,  etc. 

5.  All  performance  areas  would  be  simulated  equally,  there  is 
insufficient  evidence  to  assume  otherwise. 
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Table  8.  NUM(i,j)  per  year 


1 

2 

3 

4 

7200 

7200 

2400 

2600 

7200 

7200 

2400 

2600 

7200 

7200 

2400 

2600 

7200 

7200 

2400 

2600 

7200 

7200 

2400 

2600 

7200 

7200 

2400 

2600 

7200 

7200 

2400 

2600 

The  values  in  this  table  would  be  used  on  a  column-by-column  basis 
depending  on  the  organizational  alternative  being  evaluated,  combining  the 
simulation  environments  available  in  a  particular  alternative.  The  remaining 
columns  would  be  set  to  0.0  to  reflect  their  nonuse  in  the  alternative. 

Total  Benefits  Model.  Table  9  shows  the  final  benefits  components  for 
Organizational  Alternative  I,  previously  defined,  while  Table  10  shows  only 
the  total  benefits  estimate  for  the  three  remaining  organizational 
alternatives. 


Table  9.  Overall  Benefits  Imputed  to  Organizational  Alternative  I 
(Using  only  CET  Environments  in  Squadrons) 

$32,598,864.00 


1 

2 

3 

4 

$4,249,872.00 

$0.00 

$0.00 

$0.00 

$4,819,824.00 

$0.00 

$0.00 

$0.00 

$4,819,824.00 

$0.00 

$0.00 

$0.00 

$4,819,824.00 

$0.00 

$0.00 

$0.00 

$4,249,872.00 

$0.00 

$0.00 

$0.00 

$4,819,824.00 

$0.00 

$0.00 

$0.00 

$4,819,824.00 

$0.00 

$0.00 

$0.00 

Table  10.  Overall  Benefits  Imputed  to  Organizational  Alternatives 


Organizational  Alternative 
Organizational  Alternative 
Organizational  Alternative 


II 

$46,890,864.00 

III 

$75,225,152.00 

IV 

$87,908,342.67 

15 


COST  MODEL  -  GENERAL  DEVELOPMENT 


The  cost  model  was  developed  in  order  to  follov,  as  closely  as  possible, 
rules  and  procedures  currently  in  use  by  the  Air  Force.  In  this  case,  the 
development  of  the  model  becomes  a  case  of  selecting,  rather  than  defining  or 
deriving,  the  key  cost  elements  vhich  must  be  used  in  evaluating 
Organizational  Alternatives.  The  following  represents  the  key  information 
vhich  must  be  considered  in  the  cost  model.  This  information  was  extracted 
from  Air  Force  Regulation  173-15,  Economic  Analysis  and  Program  Evaluation  for 
Resource  Management. 


1.  Life-Cycle  Costs  (LCC)  -  Total  costs  from  acquisition  to  disposal  of 
a  particular  alternative.  Discounted  values  for  costs. 

2.  Nonrecurring  Costs  -  One-time  costs,  unique  to  a  specific 
phase  of  a  project. 

a.  Research  and  development  costs 

b.  Investment  costs  -  costs  associated  vith  the  acquisition  of 
equipment,  real  property,  start-up  costs. 

(1)  Costs  of  acquisition,  rehabilitation  or  modification  of 
land,  buildings,  machinery,  equipment,  and  one-time  computer  softvare  costs. 

(2)  Costs  of  acquisition,  rehabilitation,  or  modifications  of 
other  capital  items  such  as  furnishings  and  fittings  required  for  the  project. 

(3)  The  cost  of  plant  rearrangement  and  tooling  associated 
with  the  project. 

(4)  The  costs  of  freight  and  insurance  required  by  the 

project. 

(5)  The  value  of  nonrecurring  services  received  from  others. 

(6)  The  costs  of  leaseholds  required  for  the  project. 

(7)  Vorking  capital  and  current  assets  on  hand  or  on  order. 

(8)  Imputed  value  of  existing  Air  Force  assets  to  be  employed 

on  the  project. 


3.  Recurring  Costs  -  Annual  costs  required  to  operate  and  maintain  a 
program  or  project. 

a.  Personnel  Costs  -  All  direct  and  indirect  costs  related  to  both 
civilian  and  military  personnel. 
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(1)  Gross  pay 

(2)  Retirement  and  disability,  health,  and  life  insurance 

(3)  Sick  leave  and  annual  leave 

(4)  Holiday  pay  and  other 

(5)  Change  of  station  or  duty  pay 

(6)  Retirement  pay 

(7)  Travel,  per  diem,  moving  expenses 

(8)  Training 

b.  Supplies  and  Material 

(1)  Directly  consumed 

(2)  Transportation  costs 

(3)  Handling,  storage  and  protection  of  material 

(4)  Cost  of  utility  services 

c.  Maintenance  and  Repair  Costs 

Sunk  costs  should  not  be  counted,  but  may  be  shown  separately  for 
information. 

Depreciation  should  only  be  used  to  estimate  terminal  values.  In 
general,  a  discount  rate  of  10  per  cent  should  be  used  vith  a  midyear 
convention.  Certain  specific  instances  may  call  for  a  different  assumption 
but  generally  not  viewed  as  necessary. 

The  following  factors  are  specified  for  the  establishment  of  the 
economic  life  estimates  for  capital  equipment. 

1.  The  economic  life  of  a  project  or  asset  is  the  time  during  which 
benefits  from  it  may  reasonably  be  expected  to  accrue  to  the  Air  Force. 

2.  Economic  life  plus  project  lead-time  determine  the  time  period  to  be 
considered  when  conducting  an  economic  analysis. 

3.  Economic  life  of  a  project  or  asset  is  set  by  the  shortest  of  its 
physical  life,  technological  life,  or  mission  life. 

4.  If  necessary,  a  residual  value  will  be  determined  to  be  used  as  a 
terminal  value. 

5.  Comparing  assets  with  different  economic  lives: 

a.  Use  terminal  value  for  the  longer  lived  alternative. 

b.  Use  common  denominator  approach  (LCM). 

A  complete  accounting  structure  focused  specifically  on  all  forms  of 
simulation  systems  is  presented  in  Knapp  and  Orlansky,  1983.  This  structure 
was  abstracted  for  the  cost  elements  viewed  as  most  pertinent  for  Organiza¬ 
tional  Alternatives  being  considered  here.  Cost  categories  are  presented  in 
Table  11.  Numbers  attached  to  the  categories  refer  to  the  original  structure. 
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Table  11.  Cost  Categories/Elements  for  Organizational  Alternatives 

A.  RESEARCH  AND  DEVELOPMENT 

5.  Prototype  Manufacturing 
7.  Program/Course/Device  Test  and  Evaluation 

B.  INITIAL  INVESTMENT 
1.  Production 

a.  Nonrecurring 

(3)  Industrial  facilities 

(4)  Other 

b.  Recurring 

(1)  Acquisition  costs 

(2)  Annual  maintenance  and  update 

c.  Initial  Spares  and  Repair  Parts 
5.  Data 

b.  Technical 

c.  Instruction  Materials 
7.  System/Project  Management 

10.  Initial  Training 

a.  Instructors  (On-Site  Operators) 

b.  Maintenance  Personnel 
12.  Other 

C.  OPERATING  AND  SUPPORT 

1.  Direct  Costs 

a.  Instructional  Costs 

(1)  Pay  and  Allowances 

(a)  Instructors 

(b)  Supervisors,  Admin,  and  Support 

(c)  Maintenance  Personnel 

(2)  Other  Government  Personnel  Costs 

(3)  Consumption 

(c)  Utilities 

(d)  Instructional  Materials 

(e)  Other 

(4)  Replenishments,  Spares 

(5)  Modification  Material 

(7)  Other  Purchased  Services 

(8)  Other 

b.  Training  Activity  Costs 

(1)  Pay  and  Allowances 

(2)  Other  Government  Personnel  Costs 

(3)  Other 

e.  Other  Direct  Costs 

2.  Indirect  Costs 

a.  Base  Operations 

b.  Inventory  and  Supply  Management 

c.  Military  Family  Housing  Support 

d.  Command  Support  Costs 

e.  Other  Indirect  Costs 


COST  MODEL  -  EXAMPLE  APPLICATION 


The  cost  model  application  vas  undertaken  from  the  basis  of  the  general 
cost  structure  and  the  design  specifications  for  the  organizational 
alternatives  as  modified  for  the  benefits  application. 


The  data  for  the  cost  model  came  from  interviews  with  AL/HRA  personnel  who 
vere  very  familiar  with  the  commercial  simulation  device  market  (Thomas, 

1990),  Air  Force  cost  estimating  manuals  (Directorate  of  Engineering  and 
Services,  1988;  Grant  and  Thornley,  1987;  Voolsey,  1987),  civil  service  and 
military  pay  rates  (Air  Force.  1990)  and  the  operating  configurations  shovn  in 
Table  12. 


It  vas  assumed  that  each  organizational  alternative  would  be  manned  by 
military  and  civil  service  personnel  and  that  all  buildings  and  equipment 
vould  be  acquired  new.  It  vas  further  assumed  that  all  computer-based 
equipment  would  have  a  3-year  economic  life  and  that  all  other  capital 
equipment  vould  have  a  9-year  economic  life.  The  cost  evaluation  therefore 
has  a  life  cycle  of  9  years. 


The  organizational  alternatives  vere  disaggregated  into  their  component 
parts  (equipment  and  operational)  and  costs  vere  estimated  for  each  component. 
Table  13  shows  the  component  cost  estimates  keyed  to  the  general  cost  model. 


The  final  cost  estimates  vere  made  by  module  vithin  the  organizational 
alternatives.  That  is,  the  costs  necessary  for  one  squadron-level  simulation 
center  vere  estimated  and  then  total  costs  vere  created  by  multiplying  this 
estimate  by  the  18  squadrons  to  be  served.  Table  14  shovs  these  modular  cost 
estimates. 
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Table  12.  Operating  Characteristics  and  Configurations 


Physical  Facilities  and  Staffing.  (Staffing  keyed  to  estimated  civil  service 
grades.)  (Staffing  assumes  simulation  centers  run  on  a  12  hour/day,  5  day/veek 
basis;  Data  Base  Development  Center  run  on  an  8  hour/day,  5  day/veek  basis.) 


A.  Squadron  Training  Centers 
Physical  Facilities: 

Simulation  Room  (14'  x  20') 
Briefing  Room  (6'  x  10') 
Debriefing  Room  (6'  x  10') 
Office/Archive/Review  Room  (10'  x 

B.  Wing  Training  Centers 
Physical  Facilities: 

Simulation  Room  (30'  x  60'  x  20') 
Briefing  Room  (6'  x  10') 
Debriefing  Room  (6'  x  10') 
Office/Archive/Reviev  Room  (16'  x 

C.  Regional  Training  Center 
Physical  Facilities: 

Simulation  Room  (60'  x60'  x  20') 
Briefing  Room  (8'  x  12') 
Debriefing  Room  (8'  x  12') 
Office/Archive/Reviev  Room  (16'  x 
Administrative  Office  (12'  x  18') 


Staffing: 

Manager/Simulation  Trainer 
(1  GS  7-9) 
Technical  Assistant 
(1  GS  5-7) 


Staffing: 

Manager/Simulation  Trainer 
(1,  GS  7-9) 

Technical  Assistant 
(1,  GS  7-9) 


Staffing: 

Manager/Simulation  Trainer 
(1,  GS  7-9) 

Technical  Assistant 
(2,  GS  5-7) 

Clerical  (1,  GS  3-4) 


Data  Base  Development  Center 

BASE  CASE  (Organizational  Alternatives  I  and  II) 


Physical  Facilities: 

Data  Base  Work  Stations  (4,  5'x6') 

(includes  computer  vork  stations) 

Offices  (3,  8'  x  10') 

Meeting  Room/Archive  (10'  x  20') 

Master  Computer  Room  (10'  x  15') 

Display/Study  Simulator  (includes  one  complete 
CET  simulator  for  data  base  testing/validation 
Simulation  Room  (8'  x  16') 


Staffing: 

Manager/Technical  Director 
(1,  GS  12/13) 

Engineer /Developer /Analys  t 
(3,  GS  7-11) 
Technician/Programmer 
(3,  GS  5) 

Clerical 

(1,  GS  3-4) 


EXPANDED  CASE  (Organizational  Alternatives  III  and  IV) 


Physical  Facilities: 

Data  Base  Work  Stations  (6,  5'  x  6') 

(includes  computer  vork  stations) 

Offices  (6,  8'  x  10') 

Meeting  Room/Archive  (15'  x  30') 

Master  Computer  Room  (20'  x  30') 

Display/Study  Simulator  (includes  one  complete 
DART  simulator  for  data  base  testing/validation 
Simulation  Room  (15'  x  25'  x  20') 


Staffing: 

Manage  /Technical  Director 
(1,  GS  12/13) 

Engi neer /Developer /Analys  t 
(5,  GS  7-11) 
Technician/Programmer 
(5,  GS  5) 

Clerical 

(2,  GS  3-4) 
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Table  13.  Cost  Components  for  Organizational  Alternatives 


_ Name  of  Component 

A.  RESEARCH  AND  DEVELOPMENT 


Estimated  Cost 


5.  Prototype  Manufacturing 
7.  P/C/D  Test  and  Evaluation 


$10,000.00 

$50,000.00 


B.  INITIAL  INVESTMENT 
1.  Production 


a.  Nonrecurring 

(3)  Industrial  facilities 

Buildings  to  house  simulation  devices 
Low  Ceiling  Simulator  Room  Costs/Sq.  Ft. 
High  Ceiling  Simulator  Room  Costs/Sq.  Ft. 
Office  Building  Costs  per  Sq.  Ft. 

(4)  Other 


$87.40 

$129.40 

$107.00 

$10,000.00 


b.  Recurring 


Acquisition  cost 

Combat  Engagement  Trainer  (CET) 

Annual  Update  for  CET  cockpit 
DART  Dome 

Annual  Update  for  dome 
Visual  Display  Helmet 
Fiber  Optic  Display  Helmet  (FOHMD) 

Con  t  rol/Commun i ca  t i on/Linkage  Compu  t  er-I 

Con t rol/Communi ca t ion/ Linkage  Compu t er-II 

Host  Computer  -  Level  I 

Host  Computer  -  Level  II 

Host  Computer  -  Level  III 

Host  Computer  -  Level  IV 

Image  Generating  Computer  Level  I 

Image  Generating  Computer  Level  II 

Briefing/Debriefing  Computer  and  Displays 

GCI  Computer 


$200,000.00 

$30,000.00 

$500,000.00 

$50,000.00 

$100,000.00 

$500,000.00 

$10,000.00 

$30,000.00 

$40,000.00 

$60,000.00 

$100,000.00 

$200,000.00 

$200,000.00 

$300,000.00 

$10,000.00 

$18,000.00 


c.  Initial  Spares  and  Repair  Parts 


10.00* 


b.  Technical  $20,000.00 

c.  Instruction  Materials  $20,000.00 

7.  System/ Project  Management  $0.00 

10.  Initial  Training  - 

a.  Instructors  (On-Site  Operators)  $50,000.00 

b.  Maintenance  Personnel  $25,000.00 

12.  Other  $0’00 
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Table  13.  (Concluded) 
C.  OPERATING  AND  SUPPORT 
1.  Direct  Costs 

a.  Instructional  Costs 


(1)  Pay  and  allowances 


(a)  Instructors  (Simulation  Operators) 

- 

GS  8,  STEP  5 

$25,351.00 

GS  6,  STEP  5 

$20,598.00 

(b)  Supervisors,  Admin,  and  Support 

- 

GS  3,  STEP  5 

$14,714.00 

GS  5,  STEP  5 

$18,418.00 

GS  10,  STEP  5 

$30,834.00 

GS  12,  STEP  5 

$40,601.00 

(c)  Maintenance  Personnel 

$10,000.00 

(2) 

Other  Government  Personnel  Costs 

25.00* 

(3) 

Consumption 

- 

(c)  Utilities 

$25,000.00 

(d)  Instructional  Materials 

$10,000.00 

(e)  Other 

$0.00 

(A) 

Replenishments,  Spares 

$25,000.00 

(5) 

Modification  Material 

$100,000.00 

(7) 

Other  Purchased  Services 

$0.00 

(8) 

Other 

$0.00 

b.  Training  Activity  Costs 

(1)  Pay  and  Allowances 

CAPTAINS,  10  YEARS 

(2)  Other  Government  Personnel  Costs 

TDY,  OFFICERS,  PER  TWO  WEEKS 
TDY,  TRAVEL 

(3)  Other 

e.  Other  Direct  Costs 
2.  Indirect  Costs 

a.  Base  Operations 

b.  Inventory  and  Supply  Management 

c.  Military  Family  Housing  Support 

d.  Command  Support  Costs 

e.  Other  Indirect  Costs  $100,000.00 


$47,016.00 

$560.00 

$800.00 

25.00* 
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Table  14.  Cost  Estimates 


Modules  of  Organizational  Alternatives 


Expenditure  Type 

SQUADRON 

CET  (Pair  per 
squadron) 

Not  linked  to 
other  squad¬ 
rons 

SQUADRON 

CET  (Pair  per 
squadron) 
Linkable  to 
other  squad¬ 
rons  in  ving 

VING 

DOMES  (Pair 
per  ving) 
Linkable  to 

CETs  in 
squadrons 

Capital,  3  year 

$489,800.00 

$555,800.00 

$1,203,800.00 

Capital,  9  year 

$530,448.00 

$530,448.00 

$1,386,376.00 

Annual  costs/module 

$389,936.25 

$389,936.25 

$554,936.25 

REGION 

SYSTEM 

SYSTEM 

Regional 

National  Data 

National  Data 

Center 
(Four  domes 

Base  Center 

Base  Center 

linkable  to 

Organizational  Organizational 

any  2  pairs 

Alternatives 

Alternatives 

Expenditure  Type 

of  simulators) 

I  &  II 

III  &  IV 

Capital,  3  year 

$5,063,800.00 

$248,800.00 

$1,202,800.00 

Capital,  9  year 

$2,684,467.20 

$297,157.20 

$741,495.00 

Annual  costs/module 

$1,410,616.25 

$546,338.75 

$707,861.25 

BENEFITS  COST  APPLICATION 

The  benefits  and  cost  data  compiled  for  this  application  are  summarized  in 
Tables  15-19. 


Table  15.  Benefits  Values 


Organizational 

alternative 


Alternative  I 
Alternative  II 
Alternative  III 
Alternative  IV 


Estimated  value 
of  benefits 


$32,598,864.00 

$46,890,864.00 

$75,225,152.00 

$87,908,342.67 
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Table  16.  Cost  Values  of  Modules  for  Organizational  Alternatives 

Component  Identification 

Capital  Requirement 

CET  module 

Cet  Module 

Ving  Sim 

Time  Period 

Not  Linked 

Linked 

Centers 

3  Years 

$489,800.00 

$555,800.00 

$1,203,800.00 

9  Years 

$530,448.00 

$530,448.00 

$1,386,376.00 

Annual 

$389,936.25 

$389,936.25 

$554,936.25 

Component  Identification 

Capital  Requirement 

Region  Sim 

Data  Base 

Data  Base 

Time  Period 

Centers 

Center  I 

Center  II 

3  Years 

$5,063,800.00 

$248,800.00 

$1,202,800.00 

9  Years 

$2,684,467.20 

$297,157.20 

$741,495.00 

Annual 

$1,410,616.25 

$546,338.75 

$707,861.25 

Table  17.  Annual  Equivalent  Values  for  Modules  using 

10X 

Interest  and  the  End-of-Year  Convention 

Component  Identification 

Capital  Requirement 

CET  module 

Cet  Module 

Ving  Sim 

Time  Period 

Not  Linked 

Linked 

Centers 

3  Years 

$196,955.44 

$223,494.96 

$484,064.83 

9  Years 

$92,106.99 

$92,106.99 

$240,730.33 

Annual 

$389,936.25 

$389,936.25 

$554,936.25 

Equivalent  Annual 
Values  per  Module 

$678,998.68 

$705,538.20 

$1,279,731.41 

Component  Identification 

Capital  Requirement 

Region  Sim 

Data  Base 

Data  Base 

Time  Period 

Centers 

Center  I 

Center  II 

3  Years 

$2,036,224.87 

$100,045.96 

$483,662.72 

9  Years 

$466,130.88 

$51,598.38 

$128,753.19 

Annual 

$1,410,616.25 

$546,338.75 

$707,861.25 

Equivalent  Annual 
Values  per  Module 

$3,912,972.01 

$697,983.09 

$1,320,277.16 
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Table  18.  Benefits  and  Costa 


Annual  Equivalents  Values  for  Organizational  Alternatives  Assuaing 
18  Squadrons,  6  Wings,  4  Regional  Centers  and  1  Data  Base  Center 


Annual  Costs  Annual  Benefits 


Alternative  I 

18  squadron  centers 
Alternative  II 

18  squadron  centers,  linked 
Alternative  III 

18  squadron  centers,  linked 
plus  ving  centers 
Alternative  IV 

18  squadron  centers,  linked 
plus  regional  centers 


$12,919,959.29 

$13,397,670.72 

$21,698,353.27 

$29,671,852.83 


$32,598,864.00 

$46,890,864.00 

$75,225,152.00 

$87,908,342.67 


Table  19.  Benefit  Cost  Ratios  for  Organizational  Alternatives 

Alternative  Incremental  Incremental  Incremental 

costs  benefits  benefit  cost  ratio 


I 

$12,919,959.29 

$32,598,864.00 

2.5231 

II 

$477,711.43 

$14,292,000.00 

29.9176 

III 

$8,300,682.54 

$28,334,288.00 

3.4135 

IV 

$7,973,499.56 

$12,683,190.67 

1.5907 

As  may  be  seen  from  the  benefit  cost  ratios  for  the  organizational 
alternatives,  all  alternatives  would  be  attractive  vith  the  highest  level  of 
investment  offering  the  greatest  net  benefit  return. 

A  spreadsheet  vas  developed  to  provide  the  benefit  cost  analysis  vhich  is 
linked  to  the  spreadsheets  for  benefits  and  cost.  Vith  this  spreadsheet 
approach,  a  great  many  sensitivity  analyses  may  be  easily  performed,  varying 
any  of  the  parameters  built  into  the  models. 

BENEFITS  COST  -  SECOND  APPLICATION 

A  second  demonstration  of  the  use  of  the  benefits  cost  model  is  predicated 
on  using  performance  areas  vhich  cannot  be  trained  or  practiced  under 
peacetime  conditions.  The  behavioral  requirements  within  these  performance 


25 


areas  are  extremely  similar  to  the  requirements  within  performance  areas  which 
are  currently  used,  therefore,  a  relatively  simple  modification  of  the 
benefits  model  will  demonstrate  the  application. 

The  two  sets  of  activities  are  those  required  for  the  use  of  electronic 
warfare  mechanisms  and  those  for  the  use  and  dispersal  of  chaff  during 
air-to-air  combat.  Both  of  these  activities  can  be  seen  as  taking  place 
during  the  performance  areas  of  Air  Superiority  and  Air  Defense  Intercepts. 
Both  of  these  performance  areas  would  require  minimal  additional  time  on  the 
part  of  a  pilot  during  a  sortie  designed  for  their  practice/maintenance. 
Therefore,  the  basic  values  for  the  benefits  computation  (AR,  AT,  SR,  etc.) 
would  remain  the  same;  however,  for  the  numerical  example,  the  following 
assumptions  are  made. 

1.  A  total  of  six  performance  areas  were  hypothesized  corresponding  to 
the  use  of  Electronic  Varfare  Mechanisms  and  Chaff  dispensing.  No  changes  in 
the  ESIM  values  were  assumed.  Tables  20  and  21  show  this  structure. 

Table  20.  Performance  Areas  for  Second  Example 


Performance 

(F-15  air-to-air  only)  areas 

Names  of  Performance  Areas  (i) 


Air  Superiority  -  Intercepts  (Day /Night)  -  EV  14A 
Air  Superiority  -  Intercepts  (Day /Night)  -  CHAFF  14B 
Air  Superiority  -  Intercepts  (Day/Night)  -  BOTH  14C 
Air  Defense  -  Intercepts  (Day/Night)  -  EV  18A 
Air  Defense  -  Intercepts  (Day/Night)  -  CHAFF  18B 
Air  Defense  -  Intercepts  (Day/Night)  -  BOTH  18C 


Table  21.  Matrix  of  Values  for  Emulation  Measures 

Second  Example 
ESIM(i, j) 

Performance  Simulation  Environments  (j) 

Areas  CET  CET  Domes  Regional 

Centers 


(i) 

Not  Linked 

Interlinked 

CET  in  squad 

CET  in  squad 

1 

2 

3 

4 

14A 

0.0150 

0.0300 

0.0700 

0.1000 

14B 

0.0150 

0.0300 

0.0700 

0.1000 

14C 

0.0150 

0.0300 

0.0700 

0.1000 

18A 

0.0150 

0.0300 

0.0700 

0.1000 

18B 

0.0150 

0.0300 

0.0700 

0.1000 

18C 

0.0150 

0.0300 

0.0700 

0.1000 
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2.  Weapons  use  cost  (VEAP$)  is  assumed  to  increase  greatly  in  cost  but 
only  very  approximate  estimates  could  be  made.  These  estimated  costs  are 
shovn  in  Table  22. 


Table  22.  Benefit  Conversion  Factors 


Second  Example 


Aircraft  Weapons  Loss  of  Loss  of 

Use  Use  Aircraft  Pilot 

MAC$(i)  WEAP$(i)  AIRC$(i)  PILC$(i) 


$6,300.00 

$100,000.00 

$266.00 

$116.76 

$6,300.00 

$20,000.00 

$266.00 

$116.76 

$6,300.00 

$115,000.00 

$266.00 

$116.76 

$6,300.00 

$100,000.00 

$266.00 

$116.76 

$6,300.00 

$20,000.00 

$266.00 

$116.76 

$6,300.00 

$115,000.00 

$266.00 

$116.76 

3.  Since  these  two  activities  cannot  be  practiced,  it  is  assumed  all 
simulation  sorties  would  be  devoted  to  their  practice,  dispersed  equally 
across  all  performance  areas. 


Table  23.  NUM(i,j)  Per  Year 


Second  Example 


1 

2 

3 

4 

8400 

8400 

2800 

3000 

8400 

8400 

2800 

3000 

8400 

8400 

2800 

3000 

8400 

8400 

2800 

3000 

8400 

8400 

2800 

3000 

8400 

8400 

2800 

3000 
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Results  of  this  analysis  are  shown  on  Tables  24  and  25. 

Table  24.  Benefits  and  Costs 
Second  Example 


Annual  Equivalent  Values  for  Organizational  Alternatives  Assuming 
18  Squadrons,  6  Vings,  4  Regional  Centers  and  1  Data  Base  Center 


Alternative 

Annual  Costs 

Annual  Benefits 

I 

18  Squadron  Centers 

$12,919,959.29 

$125,929,104.00 

II 

18  Squadron  Centers,  Linked 

$13,397,670.72 

$232,567,104.00 

III 

18  Squadron  Centers,  Linked 
plus  Ving  Centers 

$21,698,353.27 

$404,878,805.33 

IV 

18  Squadron  Centers,  Linked 
plus  Regional  Centers 

$29,671,852.83 

$493,356,784.00 

Table  25.  Benefit  Cost  Ratios  for  Organizational  Alternatives 


Second  Example 


Alternative 

Incremental 

costs 

Incremental 

benefits 

Incremental 
benefit  cost  ratio 

I 

$12,919,959.29 

$125,929,104.00 

9.7469 

II 

$477,711.43 

$106,638,000.00 

223.2268 

III 

$8,300,682.54 

$172,311,701.33 

20.7587 

IV 

$7,973,499.56 

$88,477,978.67 

11.0965 

While  it  is  felt  that  the  general  benefits  cost  model  presented  is  valid 
and  useful,  the  extremely  large  values  shown  in  this  example  suggest  the  need 
for  further  refinement  of  the  numerical  estimates  of  the  parameters. 

CONCLUSIONS 

This  project  has  succeeded  in  developing  a  general  approach  to  benefit 
cost  evaluation  of  multiship  simulation  systems  to  be  used  for  training  combat 
pilots.  The  usability  of  the  general  model  is  demonstrated  by  an  extensive 
application  based,  insofar  as  possible,  on  actual  data.  The  general  model  is 
implemented  into  a  series  of  three  LOTUS  1-2-3  spreadsheets  allowing  for 
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sensitivity  analysis  and  further  refinement  of  the  variable  values  used  in  its 
application.  The  application  of  these  spreadsheets  to  the  examples  presented 
in  this  paper  is  presented  in  Appendixes  B  through  F. 


RECOMMENDATIONS  FOR  FURTHER  RESEARCH 

It  is  not  claimed  that  the  results  of  this  effort  represent  a  complete  and 
polished  decision-assisting  tool.  Clearly,  additional  vork  is  needed  in 
several  areas  to  increase  its  validity  and  usefulness. 

The  most  immediate  needs  to  be  addressed  are  in  the  methodology  for 
acquiring  estimates  of  ESIM  factors  and  a  validation  method  for  these  factors. 
Several  other  factors  (AR,  SR,  MAC$,  etc.)  also  need  to  be  investigated  for 
validity.  The  model  that  is  presented  needs  to  be  subjected  to  rigorous  use 
through  sensitivity  analysis.  This  analysis  will  reveal  other  needs  for 
refinement  and  validation. 
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APPENDIX  A 
BLOCK  DIAGRAMS 

SIMULATOR  COMPONENTS  OF  ORGANIZATIONAL  ALTERNATIVES 


33 


CET’s  (pair)  in  each  squadron  -  linked 
Not  linked  to  any  other  simulators 


VISUAL 

VISUAL 

DISPLAY 

DISPLAY 

HELMET 

HELMET 

CET 

CET 

(COCKPIT) 

(COCKPIT) 

HOST 

HOST 

COMPUTER 

COMPUTEF 

LEVEL  1 

LEVEL  1 

GROUND  CONTROL  COMMUNICATION/CONTROL 

INTERCEPTOR  COMPUTER  COMPUTER  -  LEVEL  I 


Link  to  ^ 
Data  Base  Center 
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CET's  (pair)  in  each  squadron  -  linked 
Able  to  link  to  all  other  simulators  in  wing 


VISUAL 

DISPLAY 

aaSBaBI 

HELMET 

CET 

CET 

(COCKPIT) 

(COCKPIT) 

HOST 

HOST 

COMPUTER 

COMPUTEF 

LEVEL  II 

LEVEL  II 

GROUND  CONTROL  COMMUNICATION/CONTROL 

INTERCEPTOR  COMPUTER  COMPUTER  -  LEVEL  II 


Link  to 
Data  Base  Center 


Links  to 

Another  Simulators 


in  Wing 
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CET’s  (pair)  in  each  squadron  -  linked 
Able  to  link  to  ail  other  simulators  in  wing 
DART  domes  in  Wing  Hdqtrs.  -  Central  Location 


VISUAL 

mSBm 

DISPLAY 

Bi 

HELMET 

CET 

CET 

(COCKPIT) 

(COCKPIT) 

HOST 

HOST 

COMPUTER 

COMPUTEF 

LEVEL  III 

LEVEL  III 
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CET’s  (pair)  in  each  squadron  -  linked 
Abie  to  link  to  aii  other  simuiators  in  wing 
DART  domes  in  Wing  Centers 

WING  CENTER 


HOST 

VISUAL 

COMPUTER 

DISPLAY 

LEVEL  III 

HELMET 

DART 

IMAGE 

DOME 

GENERATION 
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COMPUTER 
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HOST 
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CET  Regional 

Simulators  Centers 
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CET’s  (pair)  in  each  squadron  -  linked 
Able  to  link  to  all  other  simulators  in  system 
DART  domes  in  Regional  Centers 
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APPENDIX  B 
BENEFITS  MODEL 
APPLIED  TO  INITIAL  EXAMPLE 
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APPENDIX  C 
COSTS  MODEL 

THIS  MODEL  APPLIES  TO  ALL  EXAMPLES 
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WHPIVMICI  IWnUtfWB±MgfT»  Vf-  TWfe  ALTcHNftTnffc*  TO  Wt.  IWUWH; 

REVISED  *f*f80  Nocntyw  —  idhin  I  M*ntaia  no  coat  aaaootnlad  vM  M§  ooK  Mifloiy  tof  Mi  no4uii. 


* 

* 

*• 

• 

4» 

* 

* 

BQUAORON 

CET  (Pair  per 
squadron) 
Linkable  to 
other  squad¬ 
rons  m  wing. 

VANG 

DOMES  (Pair 
per  wing). 
Linkable  to 
CET.  In 
squadrons 

RBMON 

Regional 

Center 
(Four  domes 
tnkable  to 
any  2  pairs 
of  simulators) 

•TOTEM 
Hsdonal  Data 
Baas  Cantor 

Organizational 

Ahemadvee 

181 

•V STEM 
Nabonel  Data 
Base  Cento, 

Orgentatabonel 

Ahemepvee 

■  81V 

A.  RESEARCH  ANO  DEVELOPMENT 

« 

_ 

_ 

_ 

1  mumi  ad  tom*  would  be  purchased 

• 

- 

• 

- 

- 

- 

- 

based  an  designs  currently  on  hand  In  AL/HRA 

• 

- 

- 

- 

- 

- 

- 

or  would  bo  purchased  from  oommoreM  Arms. 

* 

- 

- 

- 

- 

- 

- 

Thor*  should  b*  minims!  RAO  oosts 

b 

- 

- 

- 

- 

- 

- 

except  for: 

• 

• 

- 

- 

- 

- 

“ 

6.  Prololyp*  Manufacturing 

3 

*10,000,00 

*10,000.00 

<20.000.00 

*40,000.00 

•0.00 

*0.00 

7.  PfC/D  Toot  and  Evaluation 

3 

*60.000.00 

*60,000.00 

•100.000.00 

*200,000.00 

*0.00 

*0.00 

B.  INITIAL  INVESTMENT 

• 

- 

- 

- 

_ 

_ 

_ 

1.  Production 

• 

_ 

- 

_ 

_ 

_ 

_ 

a.  Nonracurrlng 

• 

- 

- 

- 

- 

- 

- 

(3)  Indua trial  fadMas 

• 

- 

- 

- 

- 

- 

- 

Build  In  go  to  houoo  olmuloUon  doviooo 

0 

*46,446.00 

*46,446.00 

<271 ,376.00 

$629,467.20 

*87,16720 

*231,496.00 

(4)  Other 

9 

*10.000.00 

*10,000.00 

•40,000.00 

*80,000.00 

*10.00020 

*10.00020 

b.  Recurring 

• 

- 

- 

- 

- 

- 

- 

Acquisition  oooto 

• 

- 

- 

- 

- 

- 

. 

Combat  Engagement  Trainer  (CET) 

9 

*400.000.00 

*400,000.00 

•0.00 

*0.00 

*200,000.00 

*020 

Annual  Update  for  CET  ooettpH 

• 

•60.000.00 

*60,000.00 

•0.00 

*0.00 

*30,000.00 

*0.00 

DART  Domo 

9 

*0.00 

60.00 

•1,000,000.00 

*2,000,000.00 

*0.00 

*600,000.00 

Annual  Update  for  dome 

a 

*0.00 

*0.00 

•100,000.00 

*200,000.00 

*0.00 

*60,000.00 

Vleual  Dleplay  Helmet 

3 

$200,000.00 

$200,000.00 

•200,000.00 

*0.00 

*100.000.00 

*020 

Fiber  Optic  Dleplay  Helmet  (FOHMD) 

3 

$0.00 

$0.00 

•0.00 

*2,000,000.00 

*0.00 

9800200.00 

ControUCommulcatlon  AJnkago  Compute 

3 

*10,000.00 

$0.00 

•0.00 

*0.00 

*0.00 

*0.00 

Control/Commuteatlon/tJnkagt  Compute 

3 

*0.00 

$30,000.00 

•30,000.00 

*30,000.00 

*30,00020 

*30,000.00 

Hoot  Computer  -  Level  1 

3 

*80,000.00 

*0.00 

•0.00 

*0.00 

*0.00 

*0.00 

Host  Computer  -  Level  N 

3 

*0.00 

*120,000.00 

•0.00 

*0.00 

*60,000.00 

*0.00 

Hoot  Computer  -  Level  III 

3 

*0.00 

$0.00 

<200,000.00 

*0.00 

*0.00 

*0.00 

Hoot  Computer  -  Level  IV 

3 

*0.00 

$0.00 

•0.00 

*800,000.00 

*0.00 

*200,000.00 

Image  Generating  Computer  Level  1 

3 

$0.00 

*0.00 

•400,000.00 

*0.00 

*0.00 

*0.00 

Image  Generating  Computer  Level  N 

3 

*0.00 

*0.00 

•0.00 

*1.200,000.00 

*0.00 

$300,000.00 

Ground  Control  Interceptor  Computer 

3 

*18,000.00 

*16,000.00 

•IS.OOO.OO 

•18,000.00 

*16,000.00 

*16,00020 

Br  1* fin g/D*brt* ting  Computer  and  Ofspla 

3 

*10,000.00 

*10,000.00 

•10,000.00 

*10,000.00 

*0.00 

•020 

c.  Initial  Spare*  and  Repair  Parte 

3 

*71,800.00 

*77,800.00 

S1W.800.00 

*606,600.00 

*40,800.00 

*164200.00 

8.  Data 

• 

- 

- 

- 

- 

- 

• 

b.  Technical 

3 

*20,000.00 

$20,000.00 

•20.000.00 

*80,000.00 

*0.00 

*0.00 

c.  Instruction  Material* 

3 

*20,000.00 

*20,000.00 

•20,000.00 

*80,000.00 

60.00 

60.00 

7.  Syetem/Profect  Management 

a 

*0.00 

*0.00 

■0.00 

*0.00 

*0.00 

•020 

10.  Initial  Training 

* 

• 

- 

- 

- 

- 

- 

a.  Instructors  (On  elte  Operators) 

9 

*60,000.00 

*60,000.00 

<80.000.00 

*60.000.00 

*0.00 

*0.00 

b.  Maintenance  Personnel 

9 

$26,000.00 

*26,000.00 

•2S.000.00 

*26,000.00 

$0.00 

*0.00 

12.  Other 

9 

*0.00 

*0.00 

•0.00 

*0.00 

*0.00 

*020 

C.  OPERATING  ANO  SUPPORT 

• 

- 

- 

_ 

- 

• 

- 

1.  Direct  Costs 

• 

- 

- 

- 

- 

- 

- 

a.  Instructional  Coets 

• 

- 

- 

- 

- 

- 

- 

(1)  Pay  and  allowance* 

• 

- 

- 

- 

- 

- 

- 

(a)  Instructors  (Simulation  Operators) 

a 

$46,949.00 

*46,949.00 

•48,040.00 

*81,261.00 

*203,071.00 

*31*2*9.00 

(b)  Supervisors,  Admin,  and  8upport  Per  a 

*0.00 

$0.00 

*0.00 

*0.00 

*0.00 

*0.00 

(o)  Maintenance  Personnel 

a 

$10,000.00 

$10,000.00 

•40,000.00 

*80,000.00 

*10,000.00 

*10,000.00 

(2)  Other  Government  Personnel  Cost* 

a 

*13,967.26 

*13,967.28 

•21,487.28 

*40,31626 

*63267.76 

*81,67226 

(3)  Consumption 

• 

- 

- 

- 

- 

- 

- 

(c)Utilitie* 

a 

$26,000.00 

*26.000.00 

•37,800.00 

*60,000.00 

*26,000.00 

*26,000.00 

(d)  Instructional  Materials 

a 

*10,000.00 

*10,000.00 

•10,000.00 

•10,000.00 

*0.00 

*0.00 

(e)  Other 

a 

*0.00 

*0.00 

•0.00 

*0.00 

*0.00 

*0.00 

(4)  Replenishments,  Spare* 

a 

$26,000.00 

*26,000.00 

<100,000.00 

*160,000.00 

•26,000.00 

*26,000.00 

(5)  Modification  Material 

a 

*100,000.00 

*100,000.00 

•100,000.00 

*100,000.00 

*100,000.00 

*100,000.00 

(7)  Other  Purchased  Senrloee 

a 

*0.00 

*0.00 

•0.00 

*0.00 

*0.00 

*0.00 

(8)  Other 

a 

*0.00 

*0.00 

•0.00 

*0.00 

*0.00 

*0.00 

b.  Training  Activity  Cost* 

• 

- 

- 

- 

- 

- 

- 

(1)  Pay  and  Allowances 

a 

*0.00 

*0.00 

•0.00 

*0.00 

*0.00 

*0.00 

(2)  Other  Government  Personnel  Costs 

a 

*0.00 

*0.00 

•0.00 

*349,440.00 

*0.00 

*0.00 

(3)  Other 

a 

$0.00 

*0.00 

•0.00 

*249,600.00 

*0.00 

*0.00 

*.  Other  Direct  Coets 

« 

- 

- 

- 

*149,7*0.00 

*0.00 

*0.00 

2.  Indirect  Costs 

• 

- 

- 

- 

- 

- 

- 

a  Bee*  Operation* 

- 

- 

- 

- 

- 

- 

b.  Inventory  and  8upp!y  Management 

- 

- 

- 

- 

- 

- 

o.  Military  Family  Housing  Support 

• 

- 

- 

- 

- 

- 

- 

d.  Command  Support  Coats 

• 

- 

- 

- 

- 

- 

- 

*.  Other  Indirect  Coets 

a 

• 

*100,000.00 

*100.000.00 

•100,000.00 

*100,000.00 

*100,000.00 

*100,000.00 

Total  oosta  lor  3  year  capital  Items 

• 

• 

*489,800.00 

*666,600.00 

•1,203,800.00 

*6,063,800.00 

*248,600.00 

*1202200.00 

Total  costs  for  9  year  capital  Item* 

*630,448.00 

*630,448.00 

•1,388.378.00 

*2,684,48720 

*297,16720 

*741,4*620 

Total  oosts  lor  annual  Hem* 

*389,906.26 

*389,93626 

•884,038.26 

*M1 0,61 626 

*646,339.76 

*7072*126 
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VARMBLEDEKnnCATION  AND  RANGE  NAMES  FOB  VALUES  USED  IN  THIS  TABLE 


Variable  Idandflealion 


Name  to  be  used 
•or  Mila  variable. 
(Range  Name) 


A.  RESEARCH  AND  DEVELOPMENT 
S.  Prototype  Manufacturing 
7.  PICID  Teat  and  Evaluation 
a  INITIAL  INVESTMENT 


PROTOMANUF 

PCOTEST 


NOTES;  Souwa  si  data  (MWa 
to  AUHRA  personnel).  aaaumpdona 
Coat  par  mada.  Rata,  uaad 

Nam 

(unlaaa  shown  Number  ot  unNa  par  modula  and 
otharwlaa)  expected  Me 


•10,000.00  1  par,  3  yr,  WCN  atowanoa  sat 
•00,000.00  1  par,  Syr,  MTaat 


a.  Nonroeurrlng 

(3)  Indualrial  lacShiee 

Build  Inga  to  houaa  simulation  davloaa 

Low  Ceiling  Simulalor  Room  Costa  par  Sq.  FL 
High  Calling  Simulator  Room  Coals  par  Sq.  FL 
OMes  Budding  Coals  par  Sq.  FL 

(4)  Othsr 

b.  Raourring 

Acquisition  oosta 

Combat  Engagamant  Tralnsr  (GET) 

Annual  Update  for  CET  oookpN 
DART  Doma 

Annual  Update  tor  doma 
Visual  Dlaplay  Hatrnat 
Fiber  OpUo  Display  Halmat  (FOHMO) 
ContreWCommuloatlonAJnkaRa  Computer  -  Laval  I 
ControUGommuieation/Unkage  Computer-  Laval  N 
Host  Computer  -  Laval  I 
Host  Computer  -  Laval  N 
Host  Computer  -  Laval  SI 
Host  Computer  -  Laval  IV 
hnage  Osnaratlng  Computer  Laval  I 
Image  generating  Computer  Laval  • 

Brie  fin  g/De  briefing  Computer  and  Displays 
act  Computer 

o.  Initial  Spares  and  Repair  Pans 

6.  Data 

b.  Technical 
o.  Instruetlon  Materials 

7.  8ya1em!Pro|eet  Management 
10.  Initial  Training 

a  Instructors  (On  she  Operators) 
b.  Maintenance  Personnel 
12.  Other 

C.  OPERATMG  AND  SUPPORT 
1.  Direct  Costs 

a  Instructional  Costa 

(1)  Pay  and  alowaneee 

(a)  Instructors  (Simulation  Operators) 

083.  STEPS 
080.  STEPS 

(b)  Supervisors,  Admin,  and  Support  Personnel 

083.  STEPS 
<38  8,  STEPS 
0810,  STEPS 
OS  12,  STEPS 
(e)  Maintenance  Personnel 

(2)  Other  Government  Personnel  Coats 

(3)  Consumption 

(o)UMMsa 

(d)  Instructional  Materials 
(a)  Other 

(«)  Replenishments.  Sparse 

(5)  Modification  Material 

(7)  Otftar  Purchased  Sarvtoee 
(ft)  Other 

b.  Training  Aothrity  Coats 

(1)  Pay  and  Adowanoaa 

CAPTAJN8, 10  YEARS 

(2)  Other  Oovsmmant  Personnel  Costa 

TOY,  OFFICERS,  PER  TWO  WEBtS 
TOfy,  TRAVEL 

(3)  Other 

e.  Other  Dlrsot  Coats 
2.  Indirect  Coals 

a.  Baas  Operations 

b.  Inventory  and  8upply  Management 
o.  Military  Famdy  Housing  Support 

d.  Command  Support  Coala 

a.  Other  Indirect  Coots 


L0684BLD 

HtStMBLO 

OFFBLD 

OTHERBLD 


•87.40  8  yr,  PER  SO.  FT.,  Otrec.  at  Engr.  and  Bvo.,  IBM 
*128.40  Syr,  PER  SO.  FT.,  Dime.  at  Engr.  and  Svo.,  18S8 
•107.00  8  yr,  PER  SO.  FT.,  Dbso.  ot  Engr.  and  Svo.,  igu 
•10,000.00  1  par.  S  yr,  WCM  aSewanoa  esL 


CET 

•200,000.00 

CETYRLV 

•30,000.00 

DART 

•800,000.00 

OARTYRLY 

•80,000.00 

VDHELM 

•100.000.00 

FOHMD 

8800.000.00 

COHCOMPI 

•10,000.00 

OONCOMP8 

•30,000.00 

HOSTCOMPI 

•40,000.00 

HOSTCOMPN 

•80,000.00 

HOSTCOMPM 

<100,000.00 

HOSTCOMPIV 

•200,000.00 

K3COMPI 

•200,000.00 

•3COM  PI 

•300,000.00 

BRFCOMP 

•10.0W.M 

QCICOMP 

•18,000.00 

MT8PRS 

10.0041 

8  yr,  2  per,  MT  and  08 
arm,  2  per,  MT  and  OS 
Syr,  2  or  4  per,  MT 
arm,  2  or  4  par,  MT 

3  yr.  2  or  4  per,  MT  and  QB.  WCM.  nine. 
3  yr,  4  par,  4  oh  annals.  MT 
3  yr,  1  per,  MT  (087) 

Syr,  ipar.MT 
3  yr,  2  par.  MT  and  08 
Syr,  2  par,  MT  and  08 
Syr,  2 par,  MT  and  08 
Syr,  4  par,  MT 
Syr,  2  par,  MT  and  OB 
3  yr,  4  par,  MT  and  08 
Syr,  1  per,  MT 
Syr,  1  per,  QB 

3  yr,  2  or  4  per,  oomp.  equip,  afcvanoe 


TECHDATA 

MSTDATA 

QENMOT 


•20,000.00  3  yr,  1  par,  DA  and  WCM,  alowanoe 
•20,000.00  3  yr.  l  par,  DA  and  WCM,  edowwtoa 
•0.00  ann.  AvaNatila  as  needed  tor  aSowanoe 


TRAMM8T 

TRAMMAM 

OTHER88T*IVE8T 


•80,000.00  8  yr.  1  per.  DA  and  WCM 
•28,000.00  Syr,  1  par.  DA  and  WCM 

KAO  StsOyt.Rri— Ola  an  needed  lot  aKwantie 


<38388 

(38686 

<381088 

081288 

QENMAM 

FRINGE 


•28,361.00  arm.  1  par,  WCM  design,  08  Pap  Rate 
•20,888.00  ann.  1  per.  WCM  design,  08  Pap  Rees 

•14,714.00  ann,  l  or  2  par,  WCM  daaign.  OS  Pap  Rats 
•1ft.41B.00  ann,  3  or  6  par.  ACM  design,  08  Pap  Rate 
•30.ft34.00  ann.  3  er  8  par,  WCM  design.  08  Pap  Rate 
•40,801.00  ann,  1  par,  WCM  design.  Os  Pap  Has 
•10,000.00  ann.  1  per,  WCM  aSowanoe 

28,00%  ann,  1  par.  Fringe  banalNa  pamanlaga 


UTILITIES 

M8TRUCCONSUMP 

OTHEROON8UM 

SPARES 

MOOMAT 

OTHERPURCH 

OTHERMST 


*26,000.00  ann,  1  per,  WCM  aSowanoe 
•10,000.00  arm,  i  per,  WCM  aNoaisnoa 

•0.00  ann,  Anaiatta  as  needed  ter  aSowanoe 
•28,000.00  arm,  1  per,  WCM  aftnmnes 
*100,000.00  ann.  1  per.  WCM  aftownce 

•0.00  ann,  AvalMbta  as  neadad  Ibr  agowanoa 
•0.00  aim,  AvaAable  aa  neadad  ter  aSewanoa 


OFFICERS 

TDVDAM.Y 

TDVTRAVEL 

CTHERPER8C8T 


•47,018.00  ann,  Only  used  K  required.  Ml  Pap  Rates 

•800.00  ann,  daiy  rats  used  ter  Regional  oentsra 
•800.00  ann.  par  trip  uasd  ter  Regional  esntars 
28.00%  arm,  a»ewanna,  detarmkiad  tram  G8  or  Ml 


0THERM0C8T8 


8100,000.00  ann,  i  per,  WCM  alewsnes 
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APPENDIX  D 

BENEFIT-COST  ANALYSIS 
INITIAL  EXAMPLE 
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